Continuous sigmoidal belief networkstrained using slice samplingBrendan
نویسنده
چکیده
Real-valued random hidden variables can be useful for modelling latent structure that explains correlations among observed variables. I propose a simple unit that adds zero-mean Gaussian noise to its input before passing it through a sigmoidal squashing function. Such units can produce a variety of useful behaviors, ranging from deterministic to binary stochastic to continuous stochastic. I show how \slice sampling" can be used for inference and learning in top-down networks of these units and demonstrate learning on two simple problems.
منابع مشابه
Continuous Sigmoidal Belief Networks Trained using Slice Sampling
Real-valued random hidden variables can be useful for modelling latent structure that explains correlations among observed variables. I propose a simple unit that adds zero-mean Gaussian noise to its input before passing it through a sigmoidal squashing function. Such units can produce a variety of useful behaviors, ranging from deterministic to binary stochastic to continuous stochastic. I sho...
متن کاملSigmoidal Model for Belief Function-Based Electre Tri Method
Main decision-making problems can be described into choice, ranking or sorting of a set of alternatives or solutions. The principle of Electre TRI (ET) method is to sort alternatives ai according to criteria g j into categories Ch whose lower and upper limits are respectively bh and bh+1. The sorting procedure is based on the evaluations of outranking relations based firstly on calculation of p...
متن کاملA Variational Mean-Field Theory for Sigmoidal Belief Networks
A variational derivation of Plefka's mean-field theory is presented. This theory is then applied to sigmoidal belief networks with the aid of further approximations. Empirical evaluation on small scale networks show that the proposed approximations are quite competitive.
متن کاملToward the Development of a Robust Kinetic Model for the Cobalt Fischer-Tropsch Catalyst Lifetime Using a Novel Sigmoidal Pattern
Although catalyst deactivation rate greatly varies depending on many factors, including the catalyst structure, reactor feed composition, and operating conditions; it is usually inevitable. Since catalyst deactivation modeling has so far been poorly addressed in the literature, in the present study, nine experimental sets of cobalt based Fischer-Tropsch catalysts activity-time data were conside...
متن کاملR-DBN: A Resistive Deep Belief Network Architecture Leveraging the Intrinsic Behavior of Probabilistic Devices
A resistive deep belief network (R-DBN) architecture is developed using the physics of nanomagnets to provide a natural hardware representation for individual probabilistic neurons. Probabilistic spin logic devices (p-bits) are modeled to demonstrate a sigmoidal activation function. A hybrid CMOS/spin based weighted array structure is designed to implement a restricted Boltzmann machine (RBM). ...
متن کامل